Free-viewpoint image synthesis using superpixel segmentation
نویسنده
چکیده
A free-viewpoint image can be synthesized using color and depthmaps of reference viewpoints, via depth-image-based rendering (DIBR). In this process, three-dimensional (3D) warping is generally used. A 3Dwarped image consists of disocclusion holes with missing pixels that correspond to occluded regions in the reference images, and non-disocclusion holes due to limited sampling density of the reference images. The non-disocclusion holes are those among scattered pixels of a same region or object. These holes are larger when the reference viewpoints and the free viewpoint images have a larger physical distance. Filling these holes has a crucial impact on the quality of free-viewpoint image. In this paper, we focus on free-viewpoint image synthesis that is precisely capable of filling the non-disocclusion holes caused by limited sampling density, using superpixel segmentation. In this approach, we proposed two criteria for segmenting depth and color data of each reference viewpoint. By these criteria, we can detect which neighboring pixels should be connected or kept isolated in each references image, before being warped. Polygons enclosed by the connected pixels, i.e. superpixel, are inpainted by k-means interpolation. Our superpixel approach has a high accuracy since we use both color and depth data to detect superpixels at the location of the reference viewpoint. Therefore, once a reference image that consists of superpixels is 3D warped to a virtual viewpoint, the non-disocclusion holes are significantly reduced. Experimental results verify the advantage of our approach and demonstrate high quality of synthesized image when the virtual viewpoint is physically far from the reference viewpoints.
منابع مشابه
Change Detection from a Street Image Pair using CNN Features and Superpixel Segmentation
This paper proposes a method for detecting changes of a scene using a pair of its vehicular, omnidirectional images. Previous approaches to the problem require the use of a 3D scene model and/or pixel-level registration between different time images. They are also computationally costly for estimating city-scale changes. We propose a novel change detection method that uses features of convoluti...
متن کاملSAR Image Segmentation using Superpixel Merging Algorithm
Image segmentation is an important tool in satellite image processing and serves as an efficient front end to sophisticated algorithm and thereby simplify subsequent processing. It used to extract the meaningful objects lying in the image. The aim of the paper is to obtain the segmentation of the Synthetic Aperture Radar (SAR) image with minimum run time of the algorithm. The algorithm used for...
متن کاملSuperpixel Based Color Image Segmentation Techniques: A Review
The basic data unit of image representation, the pixel and encompassing features, form the key for the qualitative and quantitative output of any image processing step. The result of grouping pixels exhibiting similar features within local or global neighbourhood is termed as SUPERPIXEL. Computer vision research experts have conceptualised SUPERPIXEL for many decades and contributed number of s...
متن کاملEdge Adaptive Seeding for Superpixel Segmentation
Finding a suitable seeding resolution when using superpixel segmentation methods is usually challenging. Different parts of the image contain different levels of clutter, resulting in an either too dense or too coarse segmentation. Since both possible solutions cause problems with respect to subsequent processing, we propose an edge adaptive seeding for superpixel segmentation methods, generati...
متن کاملLocal Competition-Based Superpixel Segmentation Algorithm in Remote Sensing
Remote sensing technologies have been widely applied in urban environments' monitoring, synthesis and modeling. Incorporating spatial information in perceptually coherent regions, superpixel-based approaches can effectively eliminate the "salt and pepper" phenomenon which is common in pixel-wise approaches. Compared with fixed-size windows, superpixels have adaptive sizes and shapes for differe...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2017